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Abstract 

We consider an optimal investment and consumption problem for 
a Black-Scholes financial market with stochastic coefficients driven by 
a diffusion process. We assume that an agent makes consumption and 
investment decisions based on CRRA utility functions. The dynami- 
cal programming approach leads to an investigation of the Hamilton 
Jacobi Bellman (HJB) equation which is a highly non linear partial 
differential equation (PDE) of the second oder. By using the Feyn- 
man - Kac representation we prove uniqueness and smoothness of the 
solution. Moreover, we study the optimal convergence rate of the it- 
erative numerical schemes for both the value function and the optimal 
portfolio. We show, that in this case, the optimal convergence rate is 
super geometrical, i.e. is more rapid than any geometrical one. We 
apply our results to a stochastic volatility financial market. 
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1 Introduction 



One of the principal questions in mathematical finance is the optimal 
consumption-investment problem for continuous time market models. 
This paper deals with an investment problem aiming at optimal con- 
sumption during a fixed investment interval [0, T] in addition to an 
optimal terminal wealth at maturity T. Such problems are of prime 
interest for the institutional investor, selling asset funds to their cus- 
tomers, who are entitled to certain payment during the duration of 
an investment contract and expect a high return at maturity. The 
classical approach to this problem goes back to Merton and in- 
volves utility functions, more precisely, the expected utility serves as 
the functional which has to be optimized. By applying results from 
the stochastic control, explicit solutions have been obtained for fi- 
nancial markets with nonrandom coefficients (see, e.g. [9], [TT] and 
references therein). Since then, there has been a growing interest in 
consumption and investment problems and the Merton problem has 
been extended in many directions. One of the generalisations con- 
siders financial models with random coefficients such as stochastic 
volatility markets (see, e.g., [5]). In this paper for the CRRA (Con- 
stant Relative Risk Aversion) utility functions we consider the opti- 
mal consumption-investment problem for a Black-Scholes type model 
with coefficients depending on a diffusion process which is referred 
as the external stochastic factor. The pure investment problem for 
such models is considered in [17] and [16]. In these papers the au- 
thors use the dynamic programming approach and they show that 
the nonlinear HJB equation can be transformed in a quasilinear PDE. 
The similar approach has been used in [12j for optimal consumption- 
investment problems with the default risk for financial markets with 
non random coefficients. Furthermore, in [3], by making use of the 
Girsanov measure transformation the authors study a pure optimal 
consumption problem for stochastic volatility financial markets. In [1] 
and [6] the authors use dual methods. Usually, the classical existence 
and uniqueness theorem for the HJB equation is shown by the lin- 
ear PDE methods (see, for example, chapter VI. 6 and appendix E in 
[1] ) . In this paper we use the approach proposed in [2] for the optimal 
consumption-investment problem for financial markets with random 
coefficients depending on pure jumps processes. Unfortunately, we can 
not apply directly this method for our case since in [2] the HJB equa- 
tion is the integro-differential equation of the first oder. In our case 
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it is a highly non hnear PDE of the second oder. Similarly to |2] we 
study the HJB equation through the Feynman - Kac representation. 
We introduce a special metric space in which the Feynman - Kac map- 
ping is contracted. Taking this into account we show the fixed-point 
theorem for this mapping and we show that the fixed-point solution is 
the classical unique solution for HJB equation in our case. Moreover, 
using the verification theorem we provide the explicite expressions for 
the optimal investment and consumption which depend on the HJB 
solution. Therefore, to calculate the optimal strategies one needs to 
study numerical schemes for HJB equation. To this end we find an 
explicite upper bound for the approximation accuracy. Then, we min- 
imize this bound and we get the optimal convergence rate for both 
the value function and the optimal financial strategies. It turns out 
that in this case this rate is super geometrical. 

The rest of the paper is organized as follows. In section [2] we intro- 
duce the financial market, we state the main conditions on the market 
parameters and we write the HJB equation. In section [3] we state the 
main results of the paper. Section H] presents a stochastic volatility 
model as an example of applications of our results. In Section [5] we 
study the properties of the Feynman - Kac mapping. In Section [6] the 
corresponding verification theorem is stated. The proofs of the main 
results are given in Section [71 In Section [8] we consider a numerical 
example. In Appendix some auxiliary results are given. 

2 Market model 

Let (ri, J^y, (-^t)o<t<Ti f*) be a standard filtered probability space with 
two standard independent {J^t)o<t<T adapted Wiener processes (VFj)o<j<r 
and {Vt)o<t<T taking their values in and M"^ respectively, i.e. 

w, = {wl,...,wfy and v; = (y/,...,y-y. 

The prime ' denotes the transposition. Our financial market consists of 
one riskless bond (5'o(t))o<i<T and d risky stocks ('S'j(t))o<4<r governed 
by the following equations: 

r d5o(t) =r(t,y,)5o(t)dt, 

(2.1) 

dS,{t) =S,{t)^,,{t,YMt + S,{t)Y.''^^a,^{t,Y,)dWl, 
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with 5o(0) = 1 and S'j(O) = Sj for 1 < i < d. In this model r{t,y) £ 
M_,_ is the riskless interest rate, n{t,y) = {fj,i{t,y), . . . ,fj,^{t,y)y is the 
vector of stock- appreciation rates and cr{t,y) = (cjjli, y))i<jj<rf is the 
matrix of stock-volatilities. For ah y G the coefficients r{-,y), 
fJ^i'^y) G K'^ and cr{-,y) € are nonrandom cadlag functions. Here 
denotes the set of quadratic matrix of order d. Moreover, in just 
the same way as in jlTJ we assume, that the stochastic factor Y valued 
in has a dynamics governed by the following stochastic differential 
equation: 

dYt = F{t,Yt)dt + pdVt, (2.2) 

where F is a [0, T] x — )■ nonrandom function and /3 is fixed 
positive parameter. The process U is the standard Brownian motion 

defined as 

Vt = pVt + Vl - p-^aJV^ , (2.3) 

where < /) < 1 and is a fixed m x d matrix for which cr^a'^ = I^. 
Here is the identity matrix of order m. 

Moreover, we set /C = [0, T] x and we note, that for the model 
(j2.ip the risk premium is the /C — )• M"^ function defined as 

9{t, y) = a'^ {t, y){pit, y) - r{t, y) 1^) , (2.4) 

where 1^ = (1, . . . , 1)' G W^. Similarly to [lO] we consider the frac- 
tional portfolio process 

(^(t) = (</.! (t),...,(^^(t))'GM^ 

i.e. V'i(0 represent the fraction of the wealth process invested in 
the i-th. stock at the time t. The fractions for consumptions we denote 
by c = (cj)o<t<T- t'^is wealth process satisfies the following 

stochastic equation 

dX, = X,{r{t, + 7:[d{t, - c,)dt + X,7:[dW, , (2.5) 

where tt^ = a{t,Y^)ip^ and the initial endowment Xq = x. Now we 
describe the set of all admissible strategies. A portfolio control (finan- 
cial strategy) t} = i'&t)t>o — (i'^ti '^t))t>Q ^^^^ to be admissible if it is 
{J^t)o<t<T ' progressively measurable with values in M.'^ x [0, oo), such 
that 

.T r-T 

IKIIt •= / Ktl^dt < oo and / c^dt < oo a.s. (2.6) 
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and the equation (j2.5p has a unique strong a.s. positive continuous so- 
lution (-'^f )o<t<T ™ [0 5 We denote the set of admissible portfolios 
controls by V. 

In this paper we consider an agent using the CRRA utihty function 
for < 7 < 1. The goal is to maximize the expected utilities from 
the consumption on the time interval [0, T] and from the terminal 
wealth. Then for any x G W^, y G M"^ and "i? G V the value function 
of agent is 

Jix,y,{)) :=E,,, (^j\j{Xydt + [X^^ , 

were y is the conditional expectation for = x and Yq = y. Our 
goal is to maximize this function, i.e. 

sup J(x,y,i?). (2.7) 

Remark 2.1. Note, that (12. 7p is the classical Merton optimization 
problem for the market (j2.ip . (see, e.g. f^)- Pure investment 

cases of this problem are studied in JT^ and fW/ . 

2.1 Conditions 

To list the conditions for the model (12.11) we set 

ait,y) = F{t,y) + (3,aM,y), (2-8) 

where = 7-y/l — — 7). Moreover, we denote by C^'^{IC) the 

space of the functions /(t, 2/1, • • • , y^) which are i times differentiable 
with respect to t G [0, T] and j times differentiable with respect to 

We assume that the market parameters satisfy the following condi- 
tions: 

Ai) The functions r : JC ^ M^, jj : )C ^ R'^ and a : }C ^ belong 
to C^'^(/C) and have bounded derivatives. Moreover, for all (t, y) G /C 
the matrix a{t, y) is non-degenerated and 

sup {\rit,y)\ + \nit,y)\ + \a-\t,y)\) < 00 . 
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Aa) The /C M"" function F{-, •) belongs to C^'^iK.) and its partial 
derivatives are bounded. 

This condition provides the existance of a unique strong solution for 
the equation (|2.2p . On the interval [t,T] we denote this solution by 



Yt,y = (y*.s/),<^<^ with y; 

A3) There exist [0,T] x 



t,y 



—7- M continuously differentiable func- 
tions i^iji', •))i<i j<m such that for any < t < T and for any 

the ith component [«(•,•)]?, vector 



X = {x^, . . . , x^y from 
a{t,x) has the form 



[a{t,x)]i = Aiiit, 



1=1 



and, moreover, 



(2.9) 



= max max max ( |aj ^(t, z) \ , 

i,j t,z 



dt 



daij{t,z) 



dz 



< 00 . 



In the sequel, for any vector x from we denote the ith. compo- 
nent by 

Remark 2.2. In Section^we check the condition A3J for a two asset 
stochastic volatility financial market. 



2.2 The HJB equation 

Now we introduce the HJB equation for the problem ()2.7p . To this 
end, for any differentiable /C — )• M function / we denote by T)yf{t,y) 
its gradient with respect to y G M"^, i.e. 

D,/«.„)=(A/(*.rt,....^/(Vi,) 

Let now z{t, ^) be any [0, T] x M x M"^ — ;> M two times differentiable 
function. Here <j = {x,y)' , x € M and y G M™. We set 

D^^(t,?) = (z,(t,?), D^z(t,?))' 
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and 



(D,,,z(t,0)' 



where 



and 



dxdyi ' ' dxdy„ 
Im+i be fixed parameters of the follow- 



Let now q G 1^"^+^ and M G 
ing form 

. /I; Mo 

where q^j/x G M, q, /I G and Mq G M^. For these parameters 
with q^^ > we define the Hamilton function as 

Hit, q, M) = X rit, y)q^ + y)) q + - ( -L ) 



q = (q;^, q)' and M 



(2.10) 



7i Vqi/ 



\9it,y)(i.+f3JT^a'Jl\^ 
+ ' ^ 1^^ I ^ +^trMo, (2.11) 

where 7;^ = (1 — 7)^^. In this case the HJB equation is 
r ztit, ?) + Hit, D,z(t, ?), D,^^z(t, 0) = , 

(2.12) 

i z(r,?) = x^. 

To study this equation we make use of the distortion power transfor- 
mation introduced in [T7], i.e. for a positive function h we represent 
zit,y) as 

1-7 



z(t,?) = x'^/i^(t,y), e 



(2.13) 



1 - /)27 ■ 

It is easy to deduce that the function h satisfies the following quasi- 
linear PDE: 

' htit,y) +Qit,y)hit,y) + iait,y)y-Dyhit,y) 



1 



hiT,y) 



1 



0; 



(2.14) 



where 

= 1-^ (^^(*' + ^(1^ J • (2.15) 

Note that, by the condition A^) this function and its y-gradient are 
bounded. Therefore, we can set 

= sup Q{t,y) and D^= sup \DyQ{t,y)\. (2.16) 

Our goal is to study the equation (I2.14j) . By making use of the 
probabihstic representation for the hnear PDE (the Feynman-Kac for- 
mula) we show in Proposition 15.41 that the solution of this equation 
is the fixed-point solution for a special mapping of the integral type 
which will be introduced in the next section. 



3 Main results 

First, to study the equation ()2.14p we introduce a special functional 
space. Let X be the set of /C — )• [l,oo) functions from C'^'^ (/C) such 
that 

lo,i= sup {\f{t,y)\ + \BJ{t,y)\) < r* , (3.1) 



{t,y)GlC 

where 



r* = ro + m (^(2\/T + T) + D^Te^"*+Q'^^^ , (3.2) 

Fq = e*^*^ + (e'^*^ — 1)/(5^(7^. The parameter H* will be defined below 
in Section 13.11 To define a metrics in X we set 

x = a + C + l + "iL, and L, = (l + r*(7,+TZ?Je"*^, (3.3) 

where the positive parameter ( will be specified later, = (1-/9^7)"^. 
Now for any / and g from X we define the metrics as 

QM,9) = \\f-9L, (3.4) 

where 

= sup e-(^-*) {\f{t,y)\ + \BJ{t,y)\) . 

{t,2/)G/C 
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Moreover, to write the Feynman-Kac representation for the equation 
(j2.14p we need to use the stochastic process {i]v)o<v<T governed by 
the fohowing stochastic differential equation 

dr]^ = a{t,r]^)dt + fSdJJ^. (3.5) 

It should be noted that the condition A3) provides the existence and 
the uniqueness of a strong solution on any time interval [t, T] and 
initial condition y from M™. We denote this solution by ivl'^)t<v<T- 
Using this process we define the X ^ X Feynman-Kac mapping C: 

CM,y) = Bg{t,T,y) + - [ Ti f{t, s,y) ds , (3.6) 

Q* Jt 

where g{t,s,y) = exp ^ Q{u, r]u^)dv^ and 

Tifit, s,y) = E {fis, 7?*'^)) g{t, s, y) . (3.7) 

To solve the equation (|2.14p we need to find the fixed-point solution 
for the mapping C in X, i.e. 

Cj, = h. (3.8) 

To this end we construct the following iterated scheme. We set Hq = 1 
and 

h,{t,y) = C^,^Jt,y) for n>l. (3.9) 
First, we study the behavior of the deviation 

In the following theorem we show that the contraction coefficient for 
the operator ()3.6p is given by 

1 + mL^ 

A = -r- 3.10 

C + 1 + mL, 

and an appropriate choice of ^ gives the super-geometrical convergence 
rate for the sequence (/i„)„>i. 

Theorem 3.1. Under the conditions Ai)-A^) the equation (13. Sp has 
a unique solution h in X such that for any n > 1 and C > 

sup (|AJt,y)| + |Dj,AJt,y)|) <B*A", (3.11) 
where B* = e^^ (1 + r*)/(l — A) and k is given in (13. 3p . 
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The proof of this theorem is given in Section [71 

Now we can minimize the upper bound (j3.1ip over > 0. Indeed, 
setting ( = (/{! + mL^) and T = (1 + mL^)T, we obtain 

B* A" = C*exp{gJC)}, 
where C* = (1 + r*)e('3*+i+™^-)^ and 

g„(x) = xT — Inx — {n — 1) ln(l + x) . 
Now we minimize this function over x > 0, i.e. 

ming„(x) = x*T - Inx* - (n - l)ln(l + x*) , 

where 

J(f-nY + 4f + n-f 
X* . 

n 2r 

Therefore, for 

C = C = (l + mLjx; 
we obtain the optimal upper bound (|3.1ip . 

Corollary 3.2. Under the conditions A^J-A^) the equation (13. 8p has 
a unique solution h in X such that for any n > 1 

sup (|A„(t,y)| + |D^A„(t,y)|) <U;, (3.12) 

(i,y)e/c 

where = C* exp{g;}. 

Remark 3.1. One can check directly that for some 6 > 

U*^ = 0(n"'^") as n^oo. 

This means that the convergence rate is more rapid than any geomet- 
rical one, i.e. it is super geometrical. 



Theorem 3.3. Assume, that the conditions A]^)-A^) hold. Then the 
optimal value of J(x, y, •&) for optimization problem (12. 7p is given by 

max J(x,y,i?) = .J{x,y,i9*) = x'^ {h{0,y)Y , 
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where h{t,y) is the unique solution of the equation (j2.14p . Moreover, 
for all < t < T an optimal financial strategy -d* = (vr*, c*) is of the 
form 



^' " 1-7 + {l-l)h{t,Y,) ' (3.13) 
[ c* = c*(t,y,) = {h{t,Y,))-''' . 

The optimal wealth process (-^t*)o<t<T satisfies the following stochastic 
equation 

dX; = a*{t, Y,)X;dt + X;{b*{t, Yt)ydWt , X* = x, (3.14) 
where 



rit,y)-ih{t,y)y 



1* 



^ ^) = + {l-^)h{t,y) ■ 

The proof of this theorem is given in Section [71 

Remark 3.2. Note that the optimal strategy (|3.13p coincides with the 
well-known Merton strategy in the case p = 1, i.e. when the process 
Y is independent of the brownian motion W generating the financial 
market (I2.ip . Note also that, in the case < p < 1, the optimal 
investment strategy in (j3.13p depends on the external factor Y through 
the derivative of the function h. The first term in this expression is 
the well-known Merton strategy and the second term is the impact of 
the external factor. 

To calculate the optimal strategy in (|3.13p we use the sequence 
iK)n>i^ i-e- we set 

e{t,y) , n ^ 

and 

<(t,y) = (/i„(t,y))-^* . 
Theorem l3.H -Theorem 13.31 imply the following result 
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Theorem 3.4. Assume, that the conditions A^J-Ag j hold. Then for 
any n > 1 

sup (|^*(t,y)-<(t,y)| + |c*(t,y)-<(t,y)|) <B*U;, 
where B* = -fi/3e^/l - p'^\crjr* + q^. 

Remark 3.3. Note that in this paper we use only the power utility 
function x'^ with < 7 < 1. It seems that the question about the upper 
hound (j3.1ip is open for general utility functions of the CRRA type. 
The method to obtain the bound (13. lip is based on the explicite form 
of the utility function. The heart of this method is to show that the 
operator (I3.6P is contracted in a suitable functional space. To this end 
one needs to make use of the power uitility. 



3.1 Formula for W 

To write the upper bound for the partial derivatives of the function 
T-ljr{t,s,y) (see Lemma [A. 2 p we define for any q> 

(f)^ = V2 e^^ and Lg = qa^ (/J'^ + T) , (3.15) 

where (pg = q {Q^ + /3^a^/2) + {2vt? + l)q^fi~'^a1 . Using these pa- 
rameters we set 

H* = 2 max (^20i(.i + aj + ^> , {(f^^fl^ , -^^=^ ei , (3.16) 

where = ^Ta, + {TD, + Ta, (a, + 1 + ^^2) + p^^a^f and 
T= (3'^T (max (i^ , ^2) + a^f ■ 

4 Two-asset stochastic volatility model 

In this section we consider an important example of the model (|2.ip 
used in financial markets with the stochastic volatilities (see, e.g., 
|16|). This model is defined as follows: 

d5o(t) =rSQ{t)dt 
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and 



dS^it) = /ii S^{t)dt + 5i(t)ai(t,y/) (diy/ + h^dW^) ; 

dS^it) = fi^S2{t)dt + S^{t)a^{t, y/) {dwl + h^dW^) , 

where b-,^ 7^ the process = {Y^, ^i^Y is gouverned by the fohow- 
ing stochastic differential equations 

dy/ = Fi(t,y/)dt + /3duJ, 
dy/ = F2(t,y,2)dt + /3du2. 

Here = pV_i^ + \/l — p^W^ for some < p < 1, i.e. the parameter 
0-^ = 1 in ^0% . Assume, that the [0,r] x M ^ M functions are 
bounded and have bounded derivatives, i.e. 



max sup max ( \F,-{t,y) \ , 



l<i<2 (t,y) 

We assume also, that the [0, T] x 



dt 



dy 



< 00 . 



functions are such, that 



CTmax — sup max 

1<*<2 (t,y) 



dai{t,y) 



dt 



dy 



< 00 



and 



(^rmn = M mm {\a ^{t , y)\ , \a2{t,y)\) > 0. 



Obviously, that in this case the matrix cr{t,yi,y2) is non-degenerated 
and 



<7 ^{t,yi,y2) 



b: 



\ 



b; 



b* 



where b! 



'1 - ^2(^2 - "1 
components of the function (|2.4p are 



V (t, 2/1) ' cr2{t,y2) j 
\>^Y^ and b* = (bg — b;^)~^. Therefore, the 



W.yx.V2)\i 



+ 



'2.1 



l<i<2. 



where b^ ^ = b*(/ii - r), bgj = -b*(/i2 - r), b^ ^ = -^(/"i " and 
bg 2 = t)*(p2 ~ ''')• From this we obtain, that in this case function 
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(I2:8]l has the form (|2J]), i.e. 



[a{t, y„y^)], = F,{t, y,) + /3, -jf-r + -7^—. h l<i<2. 
It is easy to see, that for this model the conditions A]^)-A3) hold with 
«*<^n^a. + b*^^^^ and b, = /3, max(|bi,|). 



5 Properties of the mapping C 

Proposition 5.1. Assume, that the conditions Aj^j-Agj hold. Then 
Cf^X for any f £ X . 

Proof. Obviously, that for any f G X the mapping £j > 1. Moreover, 
setting 

fs = f{s,ril'y), (5.1) 

we represent Cj{t,y) as 

Cf{t,y) = Bg{t,T,y) + ^ E ^(t, s, y)ds . (5.2) 

Therefore, taking into account that > 1 and q^, > 1 we get 

Cf{t,y) < e«*(^-*)+ rie«-(^-*)ds < ro , (5.3) 
Jt Q* 

where the upper bound Tq is defined in (j3.2p . Moreover, Lemmas I A. 41 - 
D yield 

= E|-e(*.T,„ + l/|-«,(t..)d.. 

Therefore, applying here (j5.3p . ()A.16P and Lemmas lA. 21 we get 
£/t,y) + |D^£^(t,y)| <r*. 
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Now we have to show that the function Cjr{t,y) is continuously dif- 
ferentiable with respect to t for any f G X. Indeed, to this end we 
consider for any / from X the equation (j2.14p . i.e. 

Utit, y) +Qit, y)uit, y) + {a{t, y))'Dy u{t, y) 



u{T,y) =1. 

Setting here u(t, y) = u(T — t, y) we obtain a uniformly parabolic 
equation for u with initial condition u(0, y) = 1. Moreover, due to the 
conidtions A^) and A3) the functions Q and a have bounded partial 
derivatives with respect to y. Therefore, for any / from X Theorem 5.1 
from [13] (p. 320) with < / < 1 provides the existence of the unique 
solution of (j5.4p belonging to C^'^(/C). Applying the Ito formula to 
the process 

'n(.,r/*'^)e^:«(^'<")^^' 



t<s<T 

and taking into account the equation (j5.4p we get 

u{t,y)=Cf{t,y). (5.5) 

Therefore, the function Cf{t,y) G C^'^(/C), i.e. G X for any f G X. 
Hence Proposition 15.11 □ 



Proposition 5.2. Under the conditions the mapping C is a 

contraction in the metric space (Af, q^), i.e. for any f, g from X 

QA^f,Cg)<\gAf,9), (5.6) 
where the parameter < A < 1 is given in (|3.10p . 
Proof. First note that, for any / and g from X and for any y S 



T 



\Cf{t,y)-Cg{t,y)\ < -E / g{t,s,y) 

Jt 

< j ^Q{t,s,y) \j,-g, 



fs - ids 



ds 
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We recall that = f{s,rf^y) and = g{s,rf^y). Taking into account 
here that Q{t,s,y) < e'^*^*^*) we obtain 



\Cf{t, y) - C^it, y)\< r e«*(^-*) E|/, - g,\ds . 

Taking into account in the last inequality, that 

|7.-5j <e"(^-^)^,(/,<7) a.s., 

we get 



(5.7) 



-(^-*) {Cf{t,y) - £^{t,y)) 



< 



1 



Q.if,9)- (5.8) 



Moreover, by virtue of Lemma lA.41 we obtain, that for any 1 < i < m 
d ^ ,. . „_d_ 



-Cfit,y)=B—g{t,T,y) 



+ 



1 



q* Jt 

T 



T 

^ilr'* (fois))' v,{s)g{t,s,y)ds 



q* Jt 



d 



+ - I E{Q'-'^*—git,s,y)ds, 



(5.9) 



where /o(s) = /o(s,?7*'^), fois,z) = D^/(s,z) and Vi{s) = drff/dyi. 

E {wi{s))' Vi{s)g{t,s,y)ds 



Therefore, for any / and g from X 
dCfit,y) dCg{t,y) _l-q, 



q* Jt 

l-T 



where 



1 r d 

H / Ero2(s) — ^(t,s,y)ds. 

q* Jt dVi 

7o(s) 5o(s) 



and uj^is) = (/J ^* - (5 J 



Note, that similarly to (15. 7p 

|/o(^)-5o(«)l<e-(^-^) gM,9) 
Using this, one can check directly that 

|t:^i(s)| <(l + r*gJe-(^-^) eM,9) 



a.s. . 
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and 



2(^)1 <('Z.-l)e-(^-^) qM,9)- 
Therefore, these upper bounds and Lemma lA.31 imply 

dCf{t,y) dCg{t,y) 



where L* is given in (j3.3p . Therefore, 

sup e-(^-*) |D/^(t,y) -D^/:^(t,y)| <^^g^(f,g). 

Taking into account the definition of x in (jS.Sp , we obtain the inequal- 
ity (j5.6p . Hence Proposition 15. 2i □ 

Proposition 5.3. Under the conditions A;^)-A3) the equation Cf^ = h 
has a uniqe solution in X . 

Proof. Indeed, using the contraction of the operator Cm. X and the 
definition of the sequence (/i„)n>i (|3.9p we get, that for any n > 1 

QAh^,h^_,)<X^-^Q,{h^,h^), (5.10) 

i.e. the sequnce (|3.9p is fundamental in {X,q^). Therefore, due to 
Proposition lA.ll this sequence has a limit in X , i.e. there exits a 
function h from X for which 

lim g^{h,hj =0. 

n— >oo 

Moreover, taking into account that h^ = Cf^ ^ we obtain, that for 
any n > 1 

The last expression tends to zero as n — )• 00. Therefore g^{h, Cf^) = 0, 
i.e. h = Cf^. Propostion 15.21 implies immediately that this solution is 
unique. □ 

Proposition 5.4. Under the conditions A;^)-A3) the equation ()2.14p 
has a unique solution which is the solution h of the fixed-point equation 
Cf, = h. 
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Proof. Choosing in (j5.4p the function f = h and taking into account 
the representation ()5.5p and the equation (j3.8p we obtain, that the 
solution of the equation (j5.4p 



u = = h . 



Therefore, the function h satisfies the equation (|2.14p . Moreover, this 
solution is unique since h is the unique solution of the equation (j3.8p . 



Remark 5.1. The representation (j5.5p for the solution of the equation 
()5.4p is called the probabilistic representation or the Feynman - Kac 
formula (see, e. g., flf, p. 194). 

6 Verification theorem 

In this section we state the verification theorem from [TO]. Consider 
on the interval [0, T] the stochastic control process given by the - 
dimensional Ito process 



where (l^)o<f<T ^ standard k - dimensional Brownian motion. We 
assume that the control process •& takes values in some set 0. More- 
over, we assume that the coefficients a and b satisfy the following 
conditions 

• for all t € [0, T\ the functions a(t, •, •) and b(t, •, •) are continuous 
on X 6; 

• for every deterministic vector t; G the stochastic differential 
equation 



has a unique strong solution. 

Now we introduce admissible control processes for the equation (|6.ip . 
We set Ft = a{Wu , < w < t} for any < t < T. 

Definition 6.1. A stochastic control process i) = {'&t)o<t<T is called 
admissible on [0, T] with respect to equation ()6.ip if it is {F't)o<t<T - 



□ 




(6.1) 



d?f = a(t, ?f , I?) dt + b(t, ?f , 1?) dWt 
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progressively measurable with values in Q, and equation (|6.ip has a 
unique strong a.s. continuous solution (?^)o<t<r such that 

(|a(t,?f,i?t)| + |b(t,^f,i?t)|2)dt < oo a.s.. (6.2) 

We denote by V the set of all admissible control processes with respect 
to the equation ()6.ip . 

Moreover, let f : [0, T] x x 9 [0,00) and h : [0,oo) 
be continuous utility functions. We define the cost function by 



Jit, X, ^) = Bt,. (^j^ f (s, ?f , 1?,) ds + h( 



where Bt,x is the expectation operator conditional on = x. Our 
goal is to solve the optimization problem 

J*(t,x) := sup J{t,x,'d) . (6.3) 

To this end we introduce the Hamilton function, i.e. for any < t < T, 
q G and symmetric N x N matrix M we set 

H{t, q, M) := sup Ho{t, q, M, 1?) , (6.4) 

where 

Hoit, q, M, I?) := a'(t, i?)q + ^tr {hh'{t, i9)M) + f (t, i?) . 



In order to find the solution to (j6.3p we investigate the Hamilton- 
Jacobi- Bellman equation 

zt{t, ?) + H{t, D^z(t, ?), ^z(t, ?)) = , t G [0, T] , 

(6.5) 

z(r,o = h(0, ?gm^. 

Here denotes the partial derivative of z with respect to t, D^z{t,<;) 
the gradient vector with respect to <j in and D^ ,^z{t, q) denotes the 
symmetric hessian matrix, that is the matrix of the second order par- 
tial derivatives with respect to 

We assume that the following conditions hold: 
Hi) The functions f and h are non negative. 
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H2) There exists [0, T] x — )• (0, 00) function z{t, (;) from 
Ci'2([0,T] X M^) which satisfies the HJB equation ([63]) . 

H3) There exists a measurable function "d* : [0,T] x — )■ Q such 
that for alio <t <T and c; eR^ 

H4) There exists a unique strong solution to the ltd equation 

d?; = a*{t, )dt + h*{t,<;;)dWt, t>0, = X , (6.6) 

where a*{t,-) = a{t, ■,'&*{t,-)) and h*{t,-) = b(t, •, •))• Moreover, 
the optimal control process "d* = for <t <T belongs to V. 

H5) There exists some 6 > 1 such that for all < t < T and <^ G 
supE, (z(t,?;))^ < 00 

where 7^ is the set of all stopping times in [t,T]. 

Theorem 6.2. Assume that V 7^ and Hi) — H5) hold. Then for 
all t G [0, r] and for all x E the solution of the Hamilton- Jacobi- 
Bellman equation ()6.5p coincides with the optimal value of the cost 
function, i.e. 

z{t, x) = J* (t, x) = J* (t, x,^*), 
where the optimal strategy 'd* is defined in H3) and H4). 



7 Proofs 

7.1 Proof of Theorem 

Proposition 15.31 implies the first part of this theorem. Moreover, from 
()5.10p it is easy to see, that for each n > 1 

A" 

Thanks to Proposition 15.11 all the functions /i„ belong to , i.e. by 
the definition of the space X 

g,ihi,ho)< sup (|^i(t,y)-l| + |D <l + r*. 

(i,y)G/C 
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Taking into account that 

sup (|A„(t,y)| + |D A„(t,y)|) < e''^ Q,{h, hj , 
{t,y)e/c 

we obtain the inequahty p. lip . Hence Theorem 13.11 □ 

7.2 Proof of Theorem n 

We apply the Verification Theorem l6.2l to Problem 12. 71 for the stochas- 
tic control differential equation (j2.5p . For fixed = (tt, c), where 
TT G M'^ and c G [0, oo), the coefficients in model (16. ip are defined as 

a(t, 1?) = {x (r(t, y) + Tr'e{t, y) - c), y))' 
( xvr'; \ 



where ^ = {x,y)' G M^, TV = m + 1, = d + m, 0„ = (0, . . . ,0)' G 
is the identity matrix of the order m. Note that 



bb'(t,?,i9) 



IttP ; X 



Therefore, according to the definition of in (16. 4p . for any q and M 
of the form (l230l) 

i?o(i, ?,q, M, = X r(t, y)qi + y))'q + (x^c^ - xcqi) 

+ ^xVkP + a;vr' (^(t, y)qi + ^^Y^a'ji^ + ^trMo . 

To check the conditions Hg) — H4) we need to calculate the Hamilton 
function (j6.4p for Problem 12.71 which is defined as 

i/(t,?,q,M)= sup /7o(*>?>q.M,i?) = i^o(^>?>q,M,19o)• 
1?GK''x[o,oo) 

One can check directly, that for /i < and q^ > we obtain the form 

()2.1ip . where the optimal function 

i?o = ^9o(i,?,q,M) =(^*(t,?,q,M),c*(t,?,q,M)) and 



TT* = vr* t, ^, q, M) = ^ ; 

^1^1 (7.1) 

1 / \ 7i 

1 / 7 ^ 



c* =c*(t,?,q,M) 

X vqi 
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Proposition 15.41 implies that the HJB equation (j2.12p has a solution 
from C^'^(/C) defined in ()2.13p . It should be noted that for this func- 
tion cii = z^{t,x,y) = ^x^~^h{t^y) > and 

M = ^xxi'tjX,y) = 7(7 — l)x^~^h{t,y) < 0. Therefore, in this case the 
condition H3) holds with = (7r*(t, c*(t, ?)) and 



1-7 (l-7)^(*,y)' (7.2) 

where the function h is solution of the equation ()2.14p . 

Now we check the conditions H4) and H5). Note that the equation 
(j6.6p is identical to the equations (|2.2p and (j2.5p . Due to the condition 
A;^) the coefficients a*{t,y) and b*{t,y) are bounded. Therefore, the 
equation (|2.2p has a unique strong solution which for < t < s < T 
can be represented as 

where 

£,^, = exp !^l\b*{v,Y^)ydW, - \b*{v, yjpdt; 

It is clear, that for the bounded function b*{v, y) the process {E^ s)t<s<T 
is a quadratic intergrable martingale and by the Doob inequality 

E sup £'^^ < 4E S'^j, < 00. 

t<s<T 



This implies directly, that for any 0<t<r, x>0 and y G 



pm 



E sup X*\X* = x,Yt = y] < 00 . 

\t<s<T ^ J 

Now we recall that 

z{t,<;)=x^{h{t,y)y 

where h{t,y) is some positive function bounded by r*. Thus 

E,,z-(r,X;,yj < (r*)™^E,, {X^^ . 

Therefore, taking m = I/7 > 1 one gets 

E,,,z-(r,X;,yj < (r*)^/^E,_, sup < 00 

t<s<T 

which implies the conditions H4) and H5). Therefore, thanks to The- 
orem [6i2] we get Theorem 13.31 □ 
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8 Numerical example 



In this section through Scilab we calculate the function h{t, y) using 
the sequence p.9p with n = 14 iterations. The curve is obtained in 
the following stochastic volatility market settings: the market consists 
on one riskless asset (the bond) and a risky one (that means d = 1). 
Moreover, we set m = 1, T = 1, 

r{t, y) = 0.01(1 + 0.5 sin(yt)) , /x(t, y) = 0.02(1 + 0.5 sin(yt)) 

and <T{t,y) = 0.5 + sin^(yt). The parameters of the economic factor 
are F{t,y) = O.lsin(yt), (3 = 1 and p = 0.5. The utility function 
parameter is 7 = 0, 75. 




Figure 1: The function h(t,y) 



The second figure illustrates the super geometrical convergence 
rate for the functions (/i„)„>o- The curve represents the accuracy 6^ 
calculated at each step by 

= sup\hjt,y) - h^_^{t,y)\ . 
it,y) 
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1 2 3 4 5 6 7 8 9 10 11 12 13 U 15 



Figure 2: The accuracy 5„ at each iteration 

We observe the values of the accuracy: ^5 ~ 0.0001, 6s — 10~°^ 
and 5i4 ~ 10~^^. Moreover = Vn > 15, i.e. numerically the limit 
function h is reached at the 14*'^ iteration. 



9 Appendix 

A.l Properties of the space {?^,g^) 

Proposition A.l. {X,q^) is a complete metrical space. 

Proof. Indeed, let {fn)n>i be a fundamental sequence from (Af,^^), 
i.e. 

lim ^^(/„,/^) = 0. 

m,n— ^-oo 

Taking into account that the norm || • ||^ defined in (j3.4p is equivalent 
to the norm (13. ID . we obtain that this sequence is fundamental in 
Banach space C'''^(/C). Therefore, there exists a function / G C^'^(/C) 
such that 

ra— )-cxD 

The definition of the metrics in ()3.4p implies immediately that 
/ G A". Hence Proposition lA.ll □ 
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A. 2 Properties of the function 1-Lj- 

In this subsection we study the smoothness oiHf with respect to y. 

Lemma A. 2. Assume that the condition A3) holds. Then, for any 
0<t< s<T 



max sup sup 

l<i<m „fzR™ f^x 



d_ 



T-if{t,s,y) 



where H* is given in (j3.16p . 



Proof. First, for any y £ M™' we introduce the auxihary Brownian 
motion on the interval [t, s] as 

C^ = y + f3{U,-U^). 

By making use of this process and the Girsanov theorem (see [l^ p. 
254) we can represent the mapping Hj as 



where fi = f^~'^', 



-H^(t,5,y)=E/i(s,es)e*«) 



and 

Q,{v,y) = Q{v,y)-''^^^. 

Now we fixe some 1 < i < m and we set 

?. = [a. = yi + /3([Uj,-[UjJ . (A.3) 

We recah, that [x]^ is the ith component of the vector x E M™. Taking 
the conditional expectation with respect to ?g we represent Tij ss, 

'Hf{t,s,y)= 'Hf{s,y,z)p{z,yi)dz, (A.4) 

where y, z) = E {f,{s, 6) e*«) = z) , 

1 -IfziOli 9 9 

P(^.?/i) = ^i:^ and = - s) . 
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To calculate this conditional expectation note, that one can check 
directly that for any t < Vi < . . . < V/. < s and for any bounded 
M'' R function G 



E ,...,,J\,, = z)=B G{B^^ ,...,BJ, (A.5) 

where is the well-known Brownian Bridge on the interval [t, s] (see, 
for example, [8], p. 359), i.e. 



and = /3 ([U„]j — [UJJ. Moreover, using the representation (|2.9p 
we can represent the stochastic integral with respect to the ith com- 
ponent in (1A.2|) as 

[aiv,Cv)]id[Cy]i = J aiiv,£,y)dqy + J aj_j(u,<j^)d?^ , (A. 7) 

where 

m 

^iiv,x)= ai,i{v,xi) for x = (x^, . . . , x^)' . 

By putting 

and using the Ito formula, we can rewrite the last stochastic integral 
in (|A.7P as 

where 

d (3^ d 

Now for any vector x = (x;^, . . . , x^)' we set 

= [xi, . . . ,x^_i,0,x^^i, . . . ,x^) . (A. 8) 

Using these notations one can represent the function (]A.2p as 

$(0 = 4(s,?„yi) + «>i,(C,yi), 
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where 



and Q2,i(^;a;,yJ = Qi(t;, x) - ^^(u, x^, yj. Therefore, by the property 
(ID 

UAs^y^z) = e^»(^'^*)E f g) e*^>(«^'*)) , (A.9) 



where = . . . , • • • , [Qm) ■ Taking into ac- 

count that aj(f,^*) = aL^{v,S,y) and 



we get 

+ / Q2,i(^^,C,yi)dz;. 
Through the definition of B.^ in ()A.6P we rewrite this equahty as 

+ r (g'{v,C))' <iU,, (A.IO) 



where the function g*(f,x) G M*" is defined as 

f [a(f , x)].; for j 1^ i; 
a^[v, X) tor J = I . 

Due to the condition A3) this function is bounded, i.e. 

\g\v,x)\<2l3-^a,. (A.ll) 
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Let us show now, that for any q > 

Ee^*!,"^^''?'^) < (/) e'o^'-y^^ , (A.12) 



where (p^ and are given in (j3.15p . First note, that by the condition 
A3) 

\A^{v,z,yi)\ < ajz-y,;] +a^P^/2 

and, therefore, 

Q2,i{^^x) = Qi(.v,x) - Ai{v,z,yi) <Q^ + aJz- + 

Putting Q = g*(t',^*) and using the coefficients defined in (j3.15p . we 
obtain, that for any < t < s < T 

< r dU, + a,\^J+a,\z-y,\+a,. (A.13) 

Obviously, that for each 1 < j < m the process {[Cl,]j)t<v<s is adapted 
to the filtration {S^^)t<v<s^ where 

Therefore, for any q > the process 

is martingale, i.e. E^*^ = 1. This and (lA.lip yield 

Now we use the following multidimensional version of the Holder in- 
equality. For any integrated variables irij)i<j<m 

m m 

where (?^j)i<j<m ^'^^ positive numbers such, that Yl^=i '''J^ — 1- This 
inequality implies 

m 
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Now from ()A.13p for any q > we can estimate the expectation in 
(|A.12p in the fohowing way 



.7, l.0|\l/2 



where = aJ-\ = a, {(3-^ + T) and Og = T (Q, + ^^aj2). 
Taking into account here, that for any a € M 

we come to the upper bound (jA.12p . Obviously, that in ()A.9p the 
function < ajz — y^\. Therefore, 



sup nf{s,y,z) < 0^e(^i+"*)'^-^'' . 



(A.14) 



Moreover, from ()A.9P we get 
d 



—nf{s,y,z) = -ai^i{s,yi)nf{s,y,z 
+ e'^^^''^'y^'>n].(s,y,z) 



(A.15) 



where 



d 



Therefore, 



sup 

fax 



where ^^{t^s^yj) = d^n{^^ ^y^) / dy^. Taking into account here the 
bound (|A.12p we obtain 



sup 



n\^{s,y,z) < (<A2)^/'e^l^-^^I^EM/2(t,5). 



Moreover, through ()A.6p and (jA.lOp we can calculate directly, that 

d^j,i{v,B^) {s-v) 



+ 



{s-t) 
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where for any t < v <t and any vector x = {xi, . . . , x^)' 



dQ{v,x) daii{v,Xi) daii{v,Xi) 



dx. 



^ dz 



dv 



+ 



2 dz^ ' dv 
From the condition A3) we can estimate this function 

max sup \^^i{v,x)\ < D^ + a^{a^ + l + 

l<i<m („_a.)g/c 



Therefore, 



dajAv,B^)Y (s-v) 



dz 



(s-ty 



dv 



+ E 

This imphes directly 



(s-t) 



where the upper bound ^'^ is given in ()3.16p . Therefore, 



sup 

fex 



Now from ()A.14p and (jA.lSP it follows that 

d 



sup 



■T-Lf{s,y,z) 



where ij" = a, + ('/'2)^^^ and = max {l^ , 12/2) + a, . Now 
from ()A.4p we obtain 



dUf{t,s,y) _ f &Hf{s,y, 



p(z,yj)dz 



+ 1 iif{s,y,z) /'^ p(z, j/Jdz. 
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Taking into account here, that for any a > 
and 

we obtain the upper bound (jA.ip . Hence Lemma |A.2[ □ 

A. 3 Properties of the process (13.51) 

In this subsection we study the properties of the process r/ = i'nl'^)t<s<T 

Lemma A. 3. Under the conditions Ai)-A2) the process {ffg^)t<s<T 
is almost sure continuously differentiable with respect to y £ for 
any t < s < T , i.e. for any 1 < i < m there exists almost sure the 
derivative ?Jj(s) = drf^^ /dy^ such that 

sup sup max |fj(s)| < e"*"^ a.s.. 

0<s<rj/gM™ l<i<m 

Proof. First we introduce the matrix of the first partial derivatives 
of the function a(f , y) as 

One can check directly that the processes fj(s) satisfies the following 
differential equations 

^^V;Xs) = A^Viis) , Vi{t) = ei, 

where = Qq(s, r/*'^'), = (0, . . . , 0, 1, 0, , . . . , 0)' (only ith com- 
ponent is equal to 1). Now by applying here the Gronwall-Bellman 
inequality we obtain the upper bounds for the derivatives Vi{s). Hence 
Lemma IA.31 □ 
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A. 4 Properties of the function Q 



Now we study the partial derivatives of the function Q(t,s,y) defined 
in (j3.6p . To this end we need the following general result. 

Lemma A. 4. Let F = F{y,uj) 6e a M x J7 — )• M random bounded 
function such that for some nonrandom constant c* 



d 
dy 



F{y,u;] 



Then 



dy 



EF(y,a;) 



< c a.s. . 



B — F{y,u;). 
dy 



This Lemma follows immediately from the Lebesgue dominated con- 
vergence theorem. 

Lemma A.S. Under the conditions A^)-A2) there exist the partial 
derivatives {dG{t, s,y)/dy^)^ 



<i<m 



such that 



max sup 

l<i<m 



dGit,s,y) 



(A.16) 



and 



— Bg{t,s,y) = -E—g{t,s,y). 



Proof. Lemma lA.31 implies immediately, that 
dgit,s,y) 



g{t,s,y)Gi{t,s,y) 



where Gj(i,s,?/) = J^^ {QQ{u,rj^^y)y Vi{u)du, Qq{u,z) = 'D^Q{u,z) 
and Vj^{u) = drf^^ /dy^. Now Lemma IA.3I and Lemma IA.4I implv 
directly this lemma. 



□ 
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